Lower bounds on dissipation upon coarse graining 
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I. INTRODUCTION 

Equilibrium statistical physics provides the micro- 
scopic foundation of thermodynamics, buih around the 
concept of entropy as the logarithm of the phase volume. 
The theory has been extended to the regime of linear 
irreversible thermodynamics by identifying the entropy 
production in the regime of hnear response [l|, |2|, |3|, |4J. 
There exists to date no general theory covering far from 
equihbrium situations. However, recent results known as 
fluctuation 0, i, 0, 8, 9] or work [13, M, El, M, Q M, 
[la,[l3,[l3] theorems point to the existence of exact equal- 
ities valid independent of the distance from equilibrium. 
These equalities involve fluctuations in work or entropy 
production. For the average of these quantities, they re- 
duce to inequahties, in agreement with the second law 
of thermodynamics. For example, the Jarzynski equality 
states that {exp{—f3W)) = exp(— /3AF), where W is the 
work needed to bring a system, in contact with a heat 
bath at temperature T (/3~^ = ksT) from one initial 
equilibrium state to a flnal one, and AF is the difference 
in free energy of these states (see [IJ for a more precise 
discussion) . Then by the application of Jensen's inequal- 
ity one finds {W) > AF. While the work and fluctuation 
theorems are certainly intriguing results of speciflc inter- 
est for the study of small systems, they provide no extra 
information on the average value of work and entropy 
production. 

Parallel to these developments, the direct calculation 
of work, entropy and dissipation has proceeded follow- 
ing various channels of research. Explicit results for path 
dependent dissipation or entropy production have been 
obtained, mostly in the context of Markovian stochastic 
models [l^ [20, [2l[, [24] . The average entropy production 
goes back to earlier work |2^, [23|- Recently the micro- 
scopically exact value of the average dissipated work has 
been obtained in a set-up similar to that of the work 
theorem [23]. The connection and consistency between 
this exact Haniiltonian result and the ones derived in the 
context of stochastic models has been clarified in [2g| . 

The main issue of this paper is to discuss how this 
type of formulas can be applied when only limited infor- 
mation on the system is available. In other words how 
much of the irreversible behavior is revealed when only 



partial measurements are performed. Complimentary to 
this issue is the identification of the variables in which 
the traces of the dissipation reside. One could imagine 
that such knowledge would allow to develop mechanisms 
to either increase or decrease the dissipation. The limi- 
tations in observation can be of different nature. It could 
be that the monitoring in time is not exhaustive, but one 
only performs a finite number of punctual measurements. 
The measurement of the variables could also be crude or 
incomplete. Or both limitations could be present. We 
will show that this limited information provides a lower 
bound for the dissipation. Of particular interest is to 
know whether this bound is close to the full dissipation 
or just reproduces the general bound that is contained in 
the second law. As such, the analysis will reveal when 
and where the information on the dissipative process is 
located. For our illustration, we will focus on systems 
described by stochastic dynamics. The latter provide an 
accurate description of mesoscopic phenomena in physics, 
chemistry and biology, and have been used extensively 
especially in the context of Brownian entities appearing 
in nano and bio-technology. The additional advantage is 
that calculations can be carried out in full analytic detail. 
The lay-out of the paper is as follows. We start with a 
discussion of the basic expression for dissipation in terms 
of relative entropy and its relation to the arrow of time. 
Parallel to these developments, this result appears in the 
framework of both microscopic analysis 
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and stochastic thermodynamics |19l. [20I. [2ll. [23. [23l [24l 

for transient and steady nonequilibrium states. We ex- 
plain how this expression can be used to bound dissi- 
pation from below. We next investigate in a number 
of experimentally relevant examples, how these bounds 
apply in the case of coarse-graining applied to the mea- 
surement in time, to the choice of variables, or to both. 
The illustrations include overdamped and underdamped 
Brownian particles in moving and quenched potentials. 



II. RELATIVE ENTROPY, COARSE-GRAINING 
AND LOWER BOUNDS 



We introduce the quantity As which measures the 
irreversibility in a path realization z{t) for an arbi- 



trary stochastic process, in extension of its definition for 
Markov processes [13, [2ll. continuous time random walks 
or dynamical systems [22, |3^ : 



As = fcg In -^ ^ ' . 



(1) 



Here V is the probabiUty of observing the so-caUed for- 
ward path z(t). The tildes refer to the time-reversed 
analogue. z(t) — z(tf — t) is the time-reversed trajectory, 
in which the sign of the momenta are reversed if such 
variables appear in the description, tf is the total du- 
ration of the noncquilibrium experiment. V is then the 
probability for such a trajectory in an experiment em- 
ploying the time-reversed schedule of the perturbation. 
The study of the above trajectory-dependent quantity 
itself is of considerable interest [2l|, |30| ■ 

In this paper, we are only interested in its average (the 
notation suggests continuous variables, but the results 
arc trivially reproduced for discrete dynamics): 

{As)^kB fvz{t)V[zit)]\n^^^kBD{r\\r). 
J V[z{t)] 

(2) 
This average quantity is expressed in terms of the relative 
entropy D(7'||'P) (also called KuUback-Leibler distance) 
between the distributions V and V. The relative entropy 
has a number of extremely powerfull and useful proper- 
ties. In particular, it is a positive quantity whose value 
decreases upon any type of coarse- graining [3l| . 

More precisely, if the statistical information on the de- 
tailed path trajectory z{t) (which could be generically 
decomposed in two subsets as z = {x, y}) is not available, 
one considers the reduced trajectory Zcg = x, where the 
subscript refers to coarse-graining. Then 

DiV\\V)^DiV{z)\\Vi~z)) = Jdxdyr{x,y)ln^^^ 



= DiVixWii)) + JdxVix)fdyViy\x)ln 
>D{V{x)\\V{x))^D{V.^\\A^), 



v(v\i) 



(3) 



where Vcg is the corresponding coarse-grained probabil- 
ity. Finally, in combination with ([2]), we obtain: 

(As) = kBD{V\\V)>kBD{V,g\\Vcg)>{). (4) 

Notice that so far no assumption has been made on the 
stochastic dynamics. The above expressions are valid for 
example for deterministic systems (with distributed ini- 
tial conditions) and for non-Markovian processes. The 
quantity As is commonly regarded in many scenarios 
as the trajectory-dependent total entropy production. 
Thus, the average of As over the ensemble of trajec- 
tories corresponds to the total thermodynamic entropy 
production AS*. From the relative entropy properties, 
equation ([4]) conveys more information than the second 
law of thermodynamics itself, namely, that the total en- 
tropy production is always greater than zero and, further- 
more, that the better our description, the more precisely 



one can estimate the actual total dissipation approaching 
from below. Equation @ puts together two interesting 
concepts: the intrinsic nature of irreversibility and the 
subjective partial information due to incompleteness of 
measurements. 

In the case in which the system is initially prepared 
in equilibrium and then a transient noncquilibrium ex- 
cursion takes place, the mean total entropy production 
comes in the form of mean work dissipated, (Wdiss), 
which combined with ^ implies 

(Wdiss) = {W) ^AF> kBTDiVcsWVcs) > 0. (5) 

This equation has been proved exactly for Hamiltonian 
dynamics in 12511 and formally extended to mesoscopic de- 
scriptions in [201 . The main goal of this work is to apply 
the above formula to different Brownian systems driven 
out of equilibrium in which the effects of coarse-graining 
can be illustrated. We present three different analytically 
solvable examples, all initially prepared in equilibrium. 
First we consider an overdamped Brownian particle in a 
moving trap [30|, [32] whose trajectory is coarse-grained 
in time. Second, we introduce an underdamped Brown- 
ian particle in a suddenly changing stiffening trap. We 
measure its relative entropy at one point in time after 
the quench and then we integrate out the position and 
momentum variables. Third, by means of two linearly 
coupled underdamped Brownian particles, we study the 
flow of information on dissipation amongst several de- 
grees of freedom as a function of time. Lower bounds for 
the total mean work dissipated are derived in these three 
first examples. 



III. STUDY CASES 

A. Overdamped Brow^nian particle in a 
constant-speed moving trap 

In this section we present a solvable example, which 
is moreover of experimental relevance, namely, an over- 
damped Brownian particle subject to a moving time- 
dependent harmonic potential: 



V{x,t) = -{x-ut)'^ 



(6) 



where k is the stiffness of the trap and u is the constant 
velocity at which the trap is moved. The time evolu- 
tion of the position variable x of the overdamped particle 
obeys the following Langevin equation 



x = ~d,v{x,t)+m- 



(7) 



^{t) is a Gaussian white noise, with {^{t)^{t')) — 2T6{t — 
t'). For simplicity of notation, we have absorbed the 
friction coefficient in the time unit and the Boltzmann 
constant fc^ in the definition of temperature. 

Before proceeding to the relation between dissipation 
and relative entropy, we review the salient features of the 



energy balance. Our starting point is conservation of to- 
tal energy, or first law, at the level of a single stochastic 
trajectory [33|, during an experiment from initial time 
to final time tf. Since the particle is instantaneously 
thcrmalized at the constant temperature T of the heat 
bath, its change in energy is equal to its change in poten- 
tial energy A^^ = V{x{tf),tf) - V{x{0),0). The latter 
must be equal to the amount of work W exerted by the 
external force (sometimes called the injected work) mi- 
nus the heat Q delivered to the heat bath (also referred 
to as dissipated heat to the environment): 
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dV 
It 



dt 



dV_ 
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dV 



dt + / ^—xdt = W-Q. 
Jo ox 

(8) 

From such energy balance the fluctuating heat and work 
can be identified [3J| : the rate of heat dissipated to the 
heat bath is given by Q = —dxVx, while the work done 
per unit time in moving the external potential is W^ = 
dtV. These quantities depend on the actual realization 
of the stochastic trajectory x{t). Thus heat and work are 
random variables. The fact that injected work and dissi- 
pated heat differ by the energy stored in the particle has 
important consequences for their large deviation proper- 
ties for asymptotically large times when the latter energy 
is unbounded. The fluctuation theorem has therefore to 
be carefully reconsidered [H, [H, [13, [H, [H, S, IH . 

We are concerned here with the average work, in which 
case large deviation issues are irrelevant. Using the ex- 
plicit expression of the potential ^ , one finds 



(«'>M/"^<i')^ 



dtk{x — ut){—u) 



= u / dt{x{t) - at)) - u[{x{tf)) - (x(0))]. (9) 
Jo 

On the other hand, the average of equation ([7]) yields the 
following exact closed equation for the average position 



{x)=-{dxV)=-k{{x)-ut), 



(10) 



whose solution for an arbitrary initial condition at to will 
be useful later on: 



{x{t))=e-''^'-'»Hx{to)) + -[kt^ 

k 



1 



;-'^-(*-*°)(fcto-l)]. 

(11) 

If the system is prepared initially in equilibrium, from 
^ it is clear that {x{Q)) = 0. The translation of the 
harmonic potential does not change the free energy of 
the system, /S.F = 0. Then the dissipative work equals 
in average the external work: 



(W^dis«) = (W^)-AF=— (fcf/ 



-,-fctf 



1). (12) 



In the sequel, we will illustrate how Eq. ([5]) approaches 
to the exact dissipative work (|12p from below as we in- 
clude in the calculation of the relative entropy more in- 
formation on the paths. We will consider, as would occur 
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Figure 1: Sketch of the n-slicing procedure in which the full 
trajectory of the particle is not measured but only its position 
after time intervals At — tf/n, where tf is the total duration 
of the experiment. 



in an experimental or numerical realization of our exam- 
ple, that the position x(t) is measured only at a finite 
instants of time. This information loss about the path 
can be viewed as a coarse-graining in time. If the rela- 
tive entropy is calculated with this partial information, 
Eq. ([5]) will give us only a rigorous lower bound. The 
calculation which we are about to perform will tell us 
how fast this bound converges to the exact value. 

For simplicity we will consider that the coarse grain- 
ing is into n equal divisions At = tf/n of the total time 
duration tf. Therefore, in this n-slicing procedure, the 
full trajectory of the particle is not measured but only its 
position after time intervals of duration At. See figure 
[H The probability for a discretized path can be easily 
evaluated since the process is Markovian and Gaussian. 
Let us denote by p{xi+i\xi) the conditional probability 
for jumping from a point Xi at time ti to a point x^+i at 
time ti -f At, and let pg'' be the initial equilibrium dis- 
tribution. The probability T'cg of the n-sliced discretized 
path x= [xo, xi, ..., Xt, ..., Xn~i, Xf] is given by 



eg 



/ cgt,[*^Oi -^l 1 ■■■; '^ii '-'7 ^n — 15 '^ f \ ) 

Po^i^o) Y[p{Xi+l\x^). 
i=0 



(13) 



An analogous expression is valid for the backward path 
and probability, with superscript "tilde" again referring 
to time reversed excursion (trajectory and process). The 
central quantity we wish to evaluate is the following 
coarse-grained relative entropy J„ ; 



TDiVc^im-Pcd^)) 



T( In 



Po'^(^o) 
pf{xf) 



1=0 



In 



p{Xi+l\Xi) 
p{xi\xi+l) 



.(14) 



Note that we have multiplied by T (having absorbed fcs 



in its units) since we want to compare the above expres- 
sion with the dissipated work. The brackets (...) refer 
to the average performed with the forward distribution, 
which weights every trajectory's contribution. 

The next step is to find the general expression for 
p{xi+i\xi) and p{xi\xi+i). Since the Langevin equation 
that describes the dynamics is hnear, the conditional 
probabilities are Gaussian distributions: 



p{Xt+l\xi) = 

and 

p{Xi\Xi+i) = 
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(2:^+1 - {x^+l)xJ 
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V2w2 "^ [ 
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[Xi — \Xi)xi^i) 

2a2 




V27rcr2 





(15) 



(16) 



From equation (jlip (applied for final and initial times 
ti+i and ti, respectively, and with the appropriate initial 
condition) the conditional averages are found to be 



,-feAt 



{xi+i)j:, ^ XiB *+u; + riti, 

,-A:At 



(17) 

UJ + T] t,+i (18) 



where 



cj = -(e-''-^' + A:Ai-l), 77 = u(l - e^"'^'). (19) 
k 

Similarly, one can multiply the Langevin equation by the 
position X and then take averages. This leads to the 
following equation for the variance a^ = {x"^) — (a;)^: 

1 d o 



2dt^ 



-ka^ + T, (20) 

which yields (conditional variances starting at zero value) 



.^ ^ ?(i 



-2kAt\ 



(21) 



for both (forward and backward) cases. 

In order to obtain /„, we insert the above conditional 
probability distributions in Eq. (|14p . The final result can 
most revealingly be written in terms of the duration of 
the experiment tf and the final position of the minimum 
of the trap zq = utf. After some cumbersome calcula- 
tions, one finally gets 



T - -2L 
" " ktl 



e '=*/-l + 2ntanh[^ 
2n 



(22) 



First note that in the limit 

Eq. inD) 



CX3 one finds (cf. 



^°° - fci2"(^*/ 



-,-kt. 



- 1) = {W, 



diss/ 



(23) 



Hence the exact dissipation is, as anticipated, recovered 
in the limit of the continuous path description. We now 
turn to the following question. How is the convergence 
of /„ to (Wdiss)? First, one can verify that, for any value 
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Figure 2; (a) Plot of /„ (for n = 1, 2, 3, 4 and /oo = (W^diss)), 
as a function of the ratio of characteristic times ktf. We have 
scaled out the prefactor kz^. Note that J„ is always a lower 
bound to (VVdiss) and converges to the irreversible instanta- 
neous quench value (dashed line) and to the quasi-static limit 
(zero value) for ktf -^ and ktf -—* 00, respectively. Inset: 
the relative error E„ = ((Wdiss) — /n)/ (Wdiss) increases as a 
function of ktf. (b) Plot of I„ (for different values of ktf) as 
a function of the number of time divisions n of the trajectory. 



of the system's parameters, /„ is always a lower bound 
for the total dissipation (cf. Eq. ([5])): 



{Wdi, 



>ln>0- 



(24) 
and 



Next, as is apparent from the explicit result 
scaling kzQ, the convergence of /„ to (Wdiss) depends 
only on the ratio of the time of the experiment tf over 
the relaxation time 1/k in the harmonic potential. In 
figured (a) we plot /i up to I4, as a function of ktf. The 
convergence is surprisingly good. For example, for ktf — 
1, the error in I2 (single intermediate measurement point, 
plus the initial and the final points, which are always 
measured) is only a few percent. 

In the limit u —^ (or ktf — > cx)), that is, for a very 
slow translation of the potential, one recovers the quasi- 
static result of zero dissipated work. Note however that 
the relative rate of convergence becomes quite bad in 



this limit (cf. inset in figure [21(a)). On the other hand, 
the fit is perfect in the hniit of the irreversible quench, 
in which the potential is instantaneously switched to its 
new position. This corresponds to the limit u — > oo (or 
ktf -^ 0). One finds 

Initf ^ 0) = ifcZo' = {WdissKtf -- 0), (25) 

since the dissipated work is exactly equal to the average 
work done in instantaneously placing the particle in the 
shifted potential. 

In Fig. [21(b) we plot /„, for different values of ktf, 
as a function of the number of measured points. Note 
that the biggest jumps in /„ occur from n = 1 to n = 2, 
after which the bound quickly saturates and slowly ap- 
proaches the total mean dissipated work. The dominant 
term in the convergence of /„ to loo is easily obtained 
from Eq. ([22]) : 



/„ 



4k'tf 
12n2 



(26) 



We expect that this type of convergence, 1/n^, is valid 
for a continuous Markov process. There is a plausibility 
argument for this asymptotic behavior. The chain rule 
of the relative entropy, Eq. ([3]) , implies 



^.-E '"5 



V{yi\xi,Xi+i) 



(27) 



where yi{t) stands for the "piece" of the trajectory x{t) 
with i e [ti, ti + 1]. Under the conditions x{ti) = Xi, each 
of these pieces looks similar to the trajectories depicted 
in Fig. [Hand becomes a pinned diffusion process, which 
can be written as [H, WJ : 



y^it) 



{U+i~t)[x,+X{t)~X{U)] 

At 
{t - t,)[x,+i - X{t,+i) + X{t)] 
At 



(28) 



where X{t) is a process satisfying the same dynamics as 
x(t) but with no restrictions. Averaging the above equa- 
tion and assuming that {X{t)) is an analytical function 
of t, one has: 



(y.(^)> = 



(ti+i - t)xi + (t- ti)x. 



i+1 



At 



+ 0{At^). (29) 



Therefore, the averages of {yi{t)) in the forward and back- 
ward processes can only differ by terms of order At^ . 

On the other hand, the relative entropy between two 
Gaussian distributions with the same dispersion a and 
averages ^i and ^2 is given by: 



D{Pl\\P2) 



2cr2 



(30) 



Let us assume that yi (t) can be approximated by a Gaus- 
sian process with dispersion of order yt. If the external 



parameter does not affect the dispersion, the dominant 
term in the relative entropies in Eq. (|27p will be given by 
the difference between averages, i.e., by Eq. (|30| : 



^^ V{yt\x^,x,+i) \ _^ (nF-fJ-B)^ _ ^^3 ,^^. 
V{y,\x„x,+i)/ (t2 



If this is the case, then the asymptotic approach to the 
exact work is the same as in our example: 



loo -In ^nAt^ ^. 



(32) 



B. 



Underdamped Brow^nian particle in a suddenly 
quenched trap 



In the previous example, we discussed the effect of 
coarse graining in time for the measurement of the sin- 
gle relevant variable at hand, namely the position of the 
overdamped Brownian particle. Now we address the ad- 
ditional question about the role of specific variables (or 
degrees of freedom) in revealing the dissipation. For 
the illustration of this point we naturally turn to un- 
derdamped Brownian particles, where both position and 
momentum of the particle are relevant. Instead of con- 
sidering a moving harmonic potential with fixed strength, 
we study another experimentally significant scenario: a 
non-moving harmonic potential undergoing an instanta- 
neous quench in its stiffness, say at the initial time t = Q 
from a frequency cjo to the frequency wi . See the scheme 
in figure [3l 

The average work dissipated (IVdiss) in the instan- 
taneous quench can be evaluated as follows. The po- 
tential energy of the particle when at a position x, is 
given by Vi(x) — mujfx'^/2, where tOi is the harmonic 
frequency, with i = Q and i = 1 before and after 
the quench, respectively. The probability distribution 
of the position at the moment of the quench is given 
by p'^ix) = exp(— Vo(a;)/T)/Zo (as before, Boltzmann's 
constant is absorbed in the temperature for simplic- 
ity of notation). Here Zo, the normalization constant, 
is the familiar partition function. Averaging with re- 
spect to this distribution (notation (...)o), we conclude 
that the average work associated to the quench is given 
by {W) = {V^{x))o - (K)(x))o = {T/2){ujIIluI - 1). 
The corresponding change in free energy is found to be 
AF = -Thi{Zi/Zo) = rin(wi/wo). Therefore, the total 
dissipation in the irreversible instantaneous quench reads 



(lydis.) ^ (T^) - AF = ^ fln4 + 4 - 1 

2 V LOf LJ 



'I 



-'0 



(33) 



Note that the total dissipated work is always positive due 
to the irreversible nature of the process. 

As available statistical information we consider the 
probability distribution V^g = p for position x and mo- 
mentum p at a any single instant of time t after the 
quench (see Fig. [3]). As we have already shown in the 
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Figure 3: Sdiematic representation of tlie quendiing exper- 
iment. Tlie only information collected takes place at time t 
after the quench. Notice that at any time t, in the backward 
process the system is in equilibrium at uj\, pit) — p'''^{uii), 
whereas in the forward process the system is relaxing pre- 
cisely towards this equilibrium state. 



first example, statistical information at just one partic- 
ular time must provide a lower bound for the dissipated 
work corresponding to such quench: 

(W^di.s) > kBTD{p{x,p; t) I |p(x, -p; t)) > 0. (34) 

Below we will elucidate the effect of such coarse-graining 
implied in the punctual measurement in time (at time 
t after the quench) plus the effect of a reduction in the 
number of variables, this is, measuring only x, only p or 
both. We anticipate that this will lead to inequalities 
such as 

(Wdiss) > kBTD{p{x;t)\\p{x-t))>Q, (35) 

(Wdiss) > kBTD{p{p-t)\\~P{-P;t))>Q- (36) 

To explicitly obtain the bounds from the coarse- 
grained relative entropies appearing in equations ([M]) . 
([55)1 and ([55)) . we need to evaluate the probability distri- 
butions in forward and backward scenario. The deriva- 
tion for the backward scenario is very simple; the system 
starts at canonical equilibrium with frequency wi and the 
quench is performed at the end of the experiment (i = 
in forward time, which is the final time in the reverse ex- 
periment). The particle is then at canonical equilibrium 
with respect to the frequency uji throughout the process: 

eq, s exp [-(p V2m + mu:lx^/2)/T] 
p{x,p] t) = Pi'ix^p) = 



(37) 
Note that the above distribution is even in p, namely 
p{x,p;t) — p{x,~p;t), and Gaussian with the following 
moments: 



= (P) 
ip') 



(x~p) = 0, 
T/imu;j). 
niT. 



(38) 



One the other hand, in the forward scenario, the ini- 
tial condition is canonical with respect to the initial fre- 
quency cjQ, p{x,p\Q) — Pq'^{x,p). At t — the frequency 
is suddenly changed to lui and then kept constant along 
the whole process and, therefore, the evolution of the 
system in the forward process consists of a relaxation 
to the new equilibrium state, pi'^{x,p). Then we are 
free to decide what we call the final time of the experi- 
ment and hence the choice of the measurement time after 
the quench is also completely free. We write the famil- 
iar equations of motion for such underdamped Brownian 
particle for i > 0, 



p{t) = -mujlx{t)- Xp{t)/m + ^{t), 
x{t) = p{t)/m, 



(39) 



where A is the friction coefhcient, and ^ is Gaussian white 
noise with strength determined by the fluctuation dis- 
sipation theorem, {^it)£_{t')) = 2XTS{t - t'). The ini- 
tial condition is stipulated by the fact that prior to the 
quench at f = 0, the system is at equilibrium in a har- 
monic potential with strength ljq, i-c. it is bi-Gaussian 
with (cf. Eq. (pj) ) 



(40) 



{x)(t=o) = {p)(t=o) == {xp)(t=o) = 0, 



„2' 



{P')it= 



0) 



= T/{mujl), 
— rriT. 



Since the Langevin equation is linear, the resulting time 
dependent probability distribution p(x,p;t) remains a 
Gaussian. Therefore, it is sufficient to evaluate the en- 
suing time evolution of first- and second-order moments. 
Since there is no shift in the center position of the har- 
monic potential, the average position and momentum 
stay equal to zero: {x{t)) = {p{t)) = 0. The second order 
moments obey the following evolution equations which 
are easily obtained from the evolution equations (I39p : 
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which have to be solved with the above mentioned initial 
conditions. One finds: 
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where 



C = a^ 12 - (1 - (P' 12) cosh[iiy] - — z/sinh[ti^], (43) 
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ward and backward distributions, respectively 





Figure 4: (a) Relative entropies Dx,p, Dx and Dp measured at 
one single time t after the quench. Strongly damped regime 
(ct < 1): friction dominates inertia. D^.p and Dx decay mono- 
tonically and almost coincide, while Dp is very small and goes 
through a rise-and-fall. (b) Underdamped regime (ct > 1): 
inertia dominates friction, resulting in an out of phase oscil- 
latory decay of the relative entropies Dx and Dp. Note that 
in both cases (a) and (b), the position variable x captures at 
t — the full information on dissipation, namely, (VKdiss)- 



Note the switch from a monotonously decay {i/ real) to 
an oscillatory one (v imaginary) of the above solutions 
for the moments as a crosses the value 1 from below. 

We are now in position to evaluate the relative entropy 
between p{x,p;t) and p{x, —p]t), which in this case can 
be considered as a distance between the relaxing time 
dependent distribution p{x,p]t) and its final equilibrium 
state Pi'^{x,p), only reached for t ~* oo. Since both densi- 
ties are Gaussian (and the backward distribution is even 
in p), the following result is obtained: 

D^^p{t) = D{p{x,p;t)\\p{x,-p;t)) 
/detCa Tt{C2^C2) 



= In ' 



detCo 



(45) 
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The above result can be further simplified to 



1/ {i^){p^) 

^^•P^')-2['''{xMp')t-{xp) 



(i^) (p2) 



(46) 



-2 



(47) 

From now on, subindices in D refer to the variables con- 
tained in the probability distributions with which the 
relative entropy is evaluated. So when momentum is in- 
tegrated out from the probability distribution, the rel- 
ative entropy at time t of the position distributions, 
D{p{x;t)\\p{x;t)), yields 



^^^'^^Iv^^U 



{x')t 



1 



and its momentum analog, D{p{p;t)\\p{~p;t)), is 

{p')t 






(p2) 



1 



(48) 



(49) 



where C'2 and C'2 are the covariance matrices of the for- 



We insert in (gT]), (gSj) and (|49l) the expressions of the 
second moments calculated previously. With these ex- 
plicit results (depicted in figure |4|), we can discuss how 
well various relative entropies capture the information on 
the dissipation. First we note that at the moment of the 
quench (i = 0), the statistics of the position variable can 
account for the total work dissipated, TDx{Q) — (Wdiss), 
while no information is available from the momentum 
variable, -Dp(O) = 0. The reason is that the position at 
the time of quench is enough to evaluate the work [20| . 

Secondly, it is known that the relative entropy be- 
tween the probability distribution of a Markov process 
and its corresponding stationary state is a strictly de- 
creasing function of time [3l|. Hence, Dx^p{t) must be 
so, as one can check from our calculations plotted in fig- 
ureHl On the other hand, when only one of the variables 
is taken into account, the relative entropies can exhibit 
a richer phenomenology. The behavior is rather differ- 
ent in the weakly damped regime than in the strongly 
damped one. In the strongly damped case {a < 1) the 
relative entropies Dx^p{t) and Dx{t) just decay monoton- 
ically with time, see figure 21 (a). However, we obtain a 
non-monotonous behavior in the relative entropy of the 
momentum distribution, which is explained as follows. 
The equilibrium distribution of the momentum does not 
depend on the frequency of the oscillator. Therefore, at 
the quench time, the forward and backward momentum 
distributions are identical. However, once the potential is 
quenched, the momentum distribution will depart from 
equilibrium, due to transfers from potential to kinetic 
energy, to relax back to the same distribution at a later 
time. As a consequence Dp{t) increases from Dp{0) — 0, 
reaches a maximum and decays back to zero for long time, 
as can be seen in the inset of figure 01 (a). The maximum 
is however very low, since damping is strong. 



We can see a more pronounced and interesting effect 
in the underdamped case (a > 1). The main results are 
represented in figure|4l(b). Note the oscillatory exchange 
of information on dissipation between the position and 
velocity variables and the decay of the total information 
contained in Dx,p{t). The behavior of Dx{t) and Dp{t) is 
induced by oscillations in the potential and kinetic energy 
of the particle. The relative entropy of the x distributions 
can be written as (cfr. Eq. 



Dxit) 



av{t) — 1 — Inav'(t) 



(50) 



where av{t) is the ratio between the potential energy at 
time t and the equilibrium potential energy (at frequency 
uji). A similar expression can be obtained for Dp{t) from 
Eq. (|49p . Therefore, the relative entropy of x and p can 
be considered as a measure of the departure of the poten- 
tial and kinetic energy, respectively, from their equilib- 
rium values. These energies turn to oscillate at frequency 
v, twice the characteristic frequency of the damped os- 
cillator. 

The behavior of Dx^p{t) observed in Figure |31(b) can 
be better understood by rewriting the relative entropy in 
(l47t as follows: 



Dx,pit) = Dxit) + Dp{t) + i In (j^ 



n 



where the correlation coefficient r^ is given by 



n 



_ {xp)l 



i^'Wy 



(51) 



(52) 



Since < ri < 1, wc first note that the last term in the 
r.h.s of equation (j5ip is always positive, hence: 



(53) 



Dx,p{t) > Dx{t) + Dp{t). 



Therefore, in the present case, the sum of information 
on the dissipation gathered separately from position and 
momentum is smaller than that from both variables taken 
together. The equality sign in (|55|) is realized if r^ = 0, 
this is, when {xp)t = 0. From the oscillating ana- 
logue of the expression for {xp)t in (|42p. one easily ver- 
ifies that this occurs at specific times t = 2£li^ where 
{> ~ —\Ja'^ — 1. Since the variables are Gaussian, the 
condition of zero correlation is tantamount to the inde- 
pendency of position and momentum. 

Another interesting feature observed in figure [4] is that 
one of the variables, either x or p, loses all information 
on dissipation at another set of specific times. From 
equations (|48| and (|49|) one finds that this occurs if 
(a;^)t — {x?) or (p^)t = (p^) respectively. This is in agree- 
ment with the more general observation that the relative 
entropy of a specific degree of freedom is zero when, at a 
given time, the detailed balance condition holds, namely, 
when at that time the forward and backward distribu- 
tions are equal. 




Figure 5: Scheme of the last study case: the information on 
dissipation due to a sudden quench in the stiffness of the po- 
tential from cjo to lo\ in one subsystem is transmitted, through 
a linear coupling of strength is', to a second subsystem im- 
mersed in a heat bath at temperature T, where such informa- 
tion will get irreversibly lost. 



On the whole, an intricate transfer of information on 
dissipation is taking place between position and momen- 
tum of the underdamped Brownian particle. At the same 
time, such information on the total mean dissipated work 
is irreversibly lost by the punctual (one-time) relative en- 
tropy of x and p and transfered to the heat bath variables 
as time goes by. 



C. Flow^ of information between coupled oscillators. 

To complete the picture, we next consider the case of 
a harmonically bound underdamped Brownian particle 
that is indirectly in contact (via a second Brownian par- 
ticle) to a heat bath. The idea is that, by monitoring 
this second particle, we are including some information 
on the heat bath, of which it is supposed to be part. The 
Langevin equations of motion that describe the system 
read: 



mxx 
mxi 



muj'^{t)xi- K{xi- X2), (54) 

K{x2~xi)+^{t)-Xx2, (55) 



~mujQX2 



where (C(i)C(*')> = 2XT5{t ~ t'). As in the previous 
case, we consider the quench experiment: oscillator 1 
is initially prepared in equilibrium with wq. At t = 
we perform an instantaneous quench switching so that 
Lo[t) = wi for i > 0. Oscillator 2 is kept throughout at 
the same frequency wq, linearly coupled to oscillator 1 
with a strength K and immersed in the heat bath, which 
is modeled by means of a fluctuating force ^(t) and a 
friction term proportional to A. See figure [HI 

The time dependent probability distribution that char- 
acterizes the evolution of the whole system is a Gaussian, 



whose first moments are simply 

(Xi(i)) = (piW) = {X2{t)) = {P2{t)) = 0. (56) 

Thus we need to evaluate the second moments which, 
I 



having defined Kq = K + mwQ and Ki = K + mw\, obey 
the following set of evolution equations: 
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The system can be solved explicitly using the appropriate 
initial conditions corresponding to the equilibrium en- 
semble. However, the analytic expressions are extremely 
lengthy. In what follows, we will illustrate the obtained 
behavior via figures. 

Since the joint distribution is Gaussian (and the back- 
wards density even in p), the relative entropy involving 
all four variables xi,pi,X2 and p2 can be compactly ex- 
pressed in terms of the covariance matrices C4 and C4 : 



Dxu. 



,Xt) 



In 



detC4 
detC4 



TiiCi^Ci)-A 



The latter are the following four-by-four symmetric ma- 
trices 
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(59) 



and for the covariance matrix corresponding to the back- 
wards excursion we explicitly find 
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(60) 

From the above results, we can derive the relative en- 
tropy of all available degrees of freedom of the system 
(both positions xi and X2, and momenta pi and P2), 
along the whole time track with a single time measure- 
ment. Similarly to the underdamped oscillator case of 
the previous section, one can explore the behavior of the 
relative entropies of all possible combinations of the 4 
degrees of freedom. Some of them are plotted in figure 



[S] All the features of the model in the previous section 
are found here too: the relative entropy of the whole sys- 
tem, £'£ci,pi,x2,P2(^)' decays monotonically in time and it 
is an upper bound with respect to any other relative en- 
tropy accounting for less degrees of freedom. The relative 
entropy of subsystem 1, Dx-^^p-^(t), is oscillating in an in- 
trincate manner below the former, together with D^^ (t) 
and Dp-^{t), which transfer information periodically and 
are modulated by Dx^.p^ {t). Again, only when performed 
at the moment of the quench does the measurement con- 
cerning the position xi contain full information. 

The novelty in this case is that oscillator 1 is not 
directly in contact with the heat bath, but indirectly 
through oscillator 2. This allows for a more detailed 
study of how the information on dissipation contained in 
the first subsystem leaks out irreversibly. First it has to 
flow to the second subsystem and then it is dumped into 
the heat bath variables, where it is forever lost. Com- 
paring figure [HI (a) with[ni(b) we see that the relative en- 
tropies of oscillator 2 are significantly smaller than those 
of oscillator 1. The former receives information on the 
dissipated work at the quench only through its coupling 
to 1 and, while it bounces back some of this information 
to 1, its relative entropy Dx2,p2it) decays much faster 
because it is directly connected to the heat bath. 

The plateau for the relative entropy appearing at short 
times in figure[S]shows that most of the effect of the dissi- 
pative process (the irreversible quench) still resides inside 
the system formed by the two particles. In fact, oscillator 
1 keeps much of this information while slowly transferring 
it to oscillator 2. This depends on the coupling constant 
K hat connects both oscillators. This dependence is il- 
lustrated in figure[71 For K = 20 the general decay is fast 
since both subsystems are well coupled and information 
on the quench can quickly flow to the heat bath. How- 
ever, for K = 5 such flow is reduced and the relative en- 
tropy of oscillator 2 is almost zero but yet there is a con- 
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Figure 6: (a) Complex behavior of the relative entropies as 
a function of time for oscillator one. See text for discussion, 
(b) Same picture for oscillator two. 



Figure 7: Time evolution of the relative entropies of the 
whole system, Dxi.pi,x2,P2{'t)j oscillator one, Dxi,pi{t), and 
oscillator two, Dx2,P2i't)- In each plot a different coupling 
constant K between the oscillators is used. 



siderable difference between Dxj^,pi,x2,P2 (^) ^^id Dx^^p^ (t). 
Therefore, while oscillator 2 is "close to equilibrium" , its 
correlation with osciUator 1 stiU carries relevant informa- 
tion on the irreversible quench. This conclusion is valid 
both for positions and momenta, separately, as seen in 
Fig. [H] for K — b. As in the case of a single oscilla- 
tor, information flows from positions to momenta, but is 
mainly kept by the quenched oscillator or by correlations 
with oscillator 2, which rapidly reaches equilibrium. 



IV. CONCLUSIONS 

Dissipation is related to our ability to distinguish the 
arrow of time. As was anticipated in earlier work in the 
literature, we find that dissipation is proportional to the 
relative entropy between the probability distributions of 
forward and backward excursions, respectively. We have 
exploited such expression in terms of relative entropy to 
give rise to lower bounds for the dissipation if only partial 
information on the trajectories is available. 

Several scenarios have been discussed in order to il- 



lustrate how dissipation can be bounded from below on 
the basis of reduced information. First, when coarse- 
graining the continuous trajectory of the system into a 
reduced finite number of measurements, our analysis has 
shown that the resulting relative entropy provides reason- 
ably accurate bounds for the dissipation, even with only 
a small number of intermediate measurement points. As 
a generalization of our findings in this specific example, 
we conjecture that the relative entropy obtained from n 
measurements approaches the exact value of the dissipa- 
tion as 1/n^, for n large. These results could be especially 
useful in real experiments where trajectories are recorded 
at finite sampling rates. 

Second, we have analyzed the effect of considering a 
subset of variables instead of a detailed description of 
the system in a quench process. In this case, the time- 
arrow information, concentrated in the single position 
variable immediately after the quench, is subsequently 
transferred to the thermal bath and the other variables. 
Of special interest is the case of two oscillators, the first 
one undergoing a quench of its frequency and the sec- 
ond one in contact with a thermal bath. We recall that 
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Figure 8: Time evolution of several relative entropies illustrating the effect on correlations between positions and momenta. 



the relative entropy is constant when all the degrees of 
freedom of a Hamiltonian system are taken into account 
[23] ■ One could then expect that the information con- 
tained in the first oscillator would be transferred to the 
second one before getting lost in the thermal bath. How- 
ever, our analysis calls into question this naive picture, 
as we have shown that the oscillator coupled to the ther- 
mal bath is the first to thcrmalize. The information on 
the dissipation is mainly kept by the first oscillator or by 



correlations between the two. The generalization of our 
analysis to long chains of oscillators will help to further 
elucidate how information is spread along many degrees 
of freedom. 
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